Image output system having a customized user interface

ABSTRACT

A server is capable of performing communication with each of a multi-functional peripheral and an external terminal device. The server includes a control portion, wherein the control portion is configured to execute: storing, when the multi-functional peripheral executes image output according to a user operation that is input from the external terminal device or an operating portion provided on the multi-functional peripheral in a state where a first user interface image is displayed on the multi-functional peripheral or/and a state where a second user interface image is displayed on the external terminal device, a history of the user operation; and transmitting a content to be displayed in the first user interface image and the second user interface image based on the stored history of the user operation stored.

CROSS-NOTING PARAGRAPH

This non-provisional application is a continuation of U.S. applicationSer. No. 15/915,594 filed on Mar. 8, 2018, which is a continuation ofU.S. application Ser. No. 14/972,899 filed on Dec. 17, 2015 (now U.S.Pat. No. 9,955,029), which is a continuation of U.S. patent applicationSer. No. 14/713,281 filed on May 15, 2015 (now U.S. Pat. No. 9,247,084),which is a continuation of U.S. patent application Ser. No. 14/263,316filed on Apr. 28, 2014 (now U.S. Pat. No. 9,063,684), which is acontinuation of U.S. patent application Ser. No. 13/441,193 filed onApr. 6, 2012 (now U.S. Pat. No. 8,724,136), which claims priority under35 U.S.C. § 119(a) on Patent Application No. 2011-088954 filed in JAPANon Apr. 13, 2011, the entire contents of which all are herebyincorporated herein by reference.

FIELD OF THE INVENTION

The present invention relates to an image output system in which amulti-functional peripheral and a server are connected through anetwork.

BACKGROUND OF TEE INVENTION

Recently, in a convenience store (hereinafter, referred to as a “CVS”),a multi-functional peripheral connected to a network is used in varioussituations such as issuing of an event ticket reserved in advance,issuing of a coupon ticket, and purchase of an item also allowingelectronic transactions. On the other hand, the distribution amount ofmobile terminal apparatuses equipped with a local interface or aninterface of a wired or wireless LAN (Local Area Network) increases inrecent years. Examples of such a mobile terminal apparatus include amobile phone (which also includes one called smart phone), a mobileinformation terminal (PDA), a mobile PC (personal computer) and thelike. Moreover, also in such a use case that the multi-functionalperipheral as described above is connected from the user side, cases ofusing such a mobile terminal apparatus have been on the increase.

In addition, the development has been made in each company not only toprovide a quick service for customers by cooperating with anetwork-compliant device in cloud computing (hereinafter, referred tosimply as a “cloud”) but to improve the function of an appliance bycooperating with a serviceman who does maintenance or cooperating withtotaling processing of various information.

An end user makes a reservation or registration for a necessary functionfrom a network-compliance device such as a mobile terminal apparatus inadvance and enjoys the function such as acquisition or purchase ofinformation, a ticket and the like in accordance with the prescribedprocedure in the CVS. In addition, not only in the CVS, but also installs of companies or public institutions such as universitiessimilarly, cases where a short-distance wireless apparatus such as an IC(Integrated Circuit) card used as a student identification card or anemployee identification card is used as a trigger of acquisition orpurchase of information, a ticket and the like registered in advancehave been on the increase.

In the cloud, identification information for identifying a user is usedfor extracting various types of information (for example, see JapaneseLaid-Open Patent Publication No. 2002-108741, National Publication oftranslation No. 2008-506139, Japanese Laid-Open Patent Publication No.2000-242658 and Japanese Laid-Open Patent Publication No. 2002-203168).Japanese Laid-Open Patent Publication No. 2002-108741 discloses atechnology that an ID (Identification) code is added to digitizeddistribution information and distributed onto a broadcasting orcommunication network as distribution information with the ID code, sothat only an individual user who has an information device equipped witha function for identifying an ID code and has the ID code matched isable to view the distribution information, and an answer replied fromthe individual user is stored in a database with the ID code as a set.

National Publication of translation No. 2008-506139 discloses atechnology that user authentication and service approving are managed toaccess a plurality of networks present in a plurality of domains onlywith single identification information.

Japanese Laid-Open Patent Publication No. 2000-242658 discloses atechnology that under a distributed environment where a clientrequesting a resource service and a server providing the resourceservice are connected through a network, by using a URL (UniformResource Locator) described in a format including procedure forconverting a variable number of the URL to individual information of aclient user, even a resource provider who does not manage individualinformation provides the resource customized for a user to the userusing individual information.

Japanese Laid-Open Patent Publication No. 2002-203168 discloses atechnology that usage history information indicating a time-seriesoperational state of electric appliances recorded in a terminalapparatus capable of remote controlling is received in a server and ausage state of each electric appliance is analyzed based on the usagehistory information, and recommended information based on the analyzedusage state is provided to the terminal apparatus.

In addition, a technology that an operation panel of a multi-functionalperipheral or the like is customized according to a user is alsoproposed (for example, see Japanese Laid-Open Patent Publication No.2002-366248 and Japanese Laid-Open Patent Publication No. 2004-282673).Japanese Laid-Open Patent Publication No. 2002-366248 discloses atechnology that in a programmed operation display apparatus which isconnected to an external apparatus to be capable of performing displaycorresponding to a change in a state of the external apparatus, anindividual who operates the operation display apparatus is identified toallow the display and operation of contents corresponding to theidentified individual.

Japanese Laid-Open Patent Publication No. 2004-282673 discloses atechnology that such a user customization is carried out in a managementsystem in which OA equipment and a managing apparatus are connectedthrough a network. In the management system described in JapaneseLaid-Open Patent Publication No. 2004-282673, the OA equipment reads outidentification information from an IC card and transmits it to themanaging apparatus, and the managing apparatus transmits panelinformation stored being associated with the identification informationto the OA equipment, so that the OA equipment displays a panel imagedifferent from a panel image set to itself in accordance with the panelinformation.

With the technology described in Japanese Laid-Open Patent PublicationNo. 2004-282673, it is possible to provide, based on user identificationinformation registered in advance by a user, a user interface matchedwith the user to a multi-functional peripheral using a function of acloud, without depending on an environment of places of the store of theCVS. That is, this technology enables to provide a user-customized userinterface from a cloud server to the multi-functional peripheral, andalso to provide a user interface capable of executing a function desiredby the user, including a print function, a facsimile transmissionfunction, an internet facsimile transmission function or the like, withone click, based on the usage history till now, for example.

First, however, using the multi-functional peripheral in the same modelat all stores at all times is not realistic in view of a term requiredto introduce a system, a time of replacing devices, a production periodof a manufacturer and the like, even in the stores of the CVS of thesame chain. Second, a user does not always use a store where the multifunctional peripheral in the same model is installed. Third, there is acase where even multi-functional peripherals by the same manufacturerhas different display capability of an operation panel and contentscapable of being displayed on the operation panel even though the modelsare the same.

In view of such circumstances, in order to make it possible to alwaysuse a user interface desired by a user using the technology described inJapanese Laid-Open Patent Publication No. 2004-282673, it becomesnecessary to perform a task of advance registration in an image outputservice in advance in the same manner each time the model is differentwhen going to a store. Moreover, considering from a viewpoint ofusability, it can be required to perform such a registration task evenfor the information registered in advance, thus such convenience thatthe image output service is provided immediately on site at every storeof the CVS is not provided.

In addition, it is also desired to provide user customizationinformation including print setting information such as image qualityand a sheet size desired by the user, and the like for themulti-functional peripheral from the cloud server for the future.

SUMMARY OF THE INVENTION

An object of the present invention is to easily enable to operate with auser-customized user interface image in a multi-functional peripheral inevery model in an image output system provided with a server and aplurality of multi-functional peripherals connected to the serverthrough a network and capable of outputting an image.

A first technical means according to the present invention is an imageoutput system comprising a server and a plurality of multi-functionalperipherals connected to the server through a network and capable ofoutputting an image, wherein the multi-functional peripheral has awireless communication portion which communicates with a mobile terminalapparatus wirelessly and an authentication processing portion whichrequests user authentication to the server based on user informationincluding at least user identification information input from the mobileterminal apparatus or an operation portion provided in themulti-functional peripheral, the server has a user authenticationportion which performs user authentication in response to a request fromthe multi-functional peripheral and an interface instruction portionwhich specifies a user interface image displayed on a display portion ofthe mobile terminal apparatus for operating the multi-functionalperipheral depending on the user identification information, andinstructs the multi-functional peripheral to display the user interfaceimage on the mobile terminal apparatus when the user authentication issucceeded, and the multi-functional peripheral executes image output inaccordance with a user operation received from the mobile terminalapparatus through the wireless communication portion in a state wherethe user interface image is displayed on the mobile terminal apparatus.

A second technical means is the image output system as defined in thefirst technical means, wherein the server has a history storage portionwhich acquires from the multi-functional peripheral a history of a useroperation from the mobile terminal apparatus for storing, and theinterface instruction portion changes the user interface image specifieddepending on the user identification information, in accordance with thehistory of the user operation.

A third technical means is the image output system as defined in thefirst technical means, wherein the server has a content registrationportion which receives registration processing of a content subjected toimage output, which is performed through the network and by specifyingthe user identification information from the mobile terminal apparatusor an information processing apparatus different from the mobileterminal apparatus, and stores the content in relation to the useridentification information, and the multi-functional peripheral acquiresthe content from the server and executes image output for the acquiredcontent.

A forth technical means is the image output system as defined in thethird technical means, wherein the content registration portionregisters image output setting about the content in relation to thecontent when executing the registration processing, and themulti-functional peripheral executes image output based on the imageoutput setting acquired from the server when executing image output forthe content.

A fifth technical means is the image output system as defined in thesecond technical means, wherein the server has a content registrationportion which receives registration processing of a content subjected toimage output, which is performed through the network and by specifyingthe user identification information from the mobile terminal apparatusor an information processing apparatus different from the mobileterminal apparatus, and stores the content in relation to the useridentification information, and the multi-functional peripheral acquiresthe content from the server and executes image output for the acquiredcontent.

A sixth technical means is the image output system as defined in thefifth technical means, wherein the content registration portionregisters image output setting about the content in relation to thecontent when executing the registration processing, and themulti-functional peripheral executes image output based on the imageoutput setting acquired from the server when executing image output forthe content.

A seventh technical means is the image output system as defined in thefirst technical means, wherein when executing image output, themulti-functional peripheral executes image output for the contentacquired from the mobile terminal apparatus.

An eighth technical means is the image output system as defined in thesecond technical means, wherein when executing image output, themulti-functional peripheral executes image output for the contentacquired from the mobile terminal apparatus.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a view showing an exemplary configuration of an image outputsystem according to the present invention;

FIG. 2 is a view showing an example of an operation panel of amulti-functional peripheral in the image output system of FIG. 1;

FIG. 3 is a view showing an example of a display panel of a mobileterminal apparatus in the image output system of FIG. 1;

FIG. 4 is a view showing another example of the display panel of themobile terminal apparatus in the image output system of FIG. 1, which isa view showing an example when a user different from that of the examplein FIG. 3 is in using;

FIG. 5 is a flowchart for explaining an example of a flow when a userperforms image output using the image output system of FIG. 1; and

FIG. 6 is a flowchart for explaining an example of an operation of amulti-functional peripheral in the image output system of FIG. 1.

PREFERRED EMBODIMENTS OF THE INVENTION

FIG. 1 is a view showing an exemplary configuration of an image outputsystem according to the present invention. The image output system(hereinafter, referred to as “this system”) illustrated in FIG. 1 is asystem provided with a server, and a plurality of multi-functionalperipherals (hereinafter, referred to as “MFPs”) connected to the serverthrough a network N of a cloud.

As an example of such a server, description will be given below takingan example in which an authentication server 2, a cloud server 3 and acontent server 4 are distributed and arranged on the network N of thecloud but may not be distributed. In addition, the MFP 1 is installed ineach store of the CVS and is installed at some level of rate at least inthe store of the same franchise to provide convenience. However,description will be given assuming that the MFP 1 is installed in astore of the CVS, but this system is able to be installed in variousplaces such as public offices and schools.

This system has improved usability including use simplicity in imageoutputting by causing the MFP 1 to be cooperated with the system of thecloud. More specifically, when providing an image processing service(which may include a service for providing a content subjected to imageprocessing) for performing image output for a content subjected to imageprocessing in the MFP 1 using the MFP 1 installed in the store of theCVS, this system uses the cloud network for providing. In addition, thissystem is for eliminating burdensome by immediately cooperating withuser customization information according to the operation which has beenset once by a using user (operation panel customization information) andthe like, even at any store the MFP 1 is tried to be used by cooperatingwith the system of the cloud.

Here, printing of a target content (which may also include printing ofFAX reception data), FAX transmission through a network (internet FAXtransmission), copying in a transportable recording medium such as a USB(Universal Serial Bus) memory attached to the mobile terminal apparatus5 or the MFP 1, and the like correspond to the image output. Copying ofnot only a content purchased with a content purchasing function but alsoa content registered by a user himself/herself, which will be describedbelow correspond to the copying, since there is a case where data isrequired suddenly. This system is also called a network print systemwhen printing is included as the image output.

The MFP 1 has an operation panel 12 comprised of a display portion andan operation portion and an image output portion 14, in addition to amain control portion 10 for controlling the whole. Moreover, the MFP 1used in this system is also provided with, as a main characteristic, awireless communication portion 11 and an authentication processingportion 13 which will be described below.

Although description will be given below assuming that the operationpanel 12 has a touch panel and is also used as a part of the operationportion, the operation may be performed based on a UI image displayedonly with an operation button provided separately. For example, aprinting portion, a network adapter and the like correspond to the imageoutput portion 14. The main control portion 10 may be configured byhardware and a program (firmware). Examples of the hardware include amicro computer, a universal integrated circuit/chip set such as aprogrammable IC chip, and the like. A program for causing processing onthe MFP 1 side according to the present invention including processingof the authentication processing portion 13 to be executed whilecontrolling each of the portions 11, 12 and 14 and other not-shownportion by the hardware corresponds to the program (firmware). Moreover,the main control portion 10 may be configured only by the hardware, andin such a case, a dedicated micro computer, a dedicated integratedcircuit/chip set or the like may be mounted for executing controlling ofeach of the portions 11 to 14 and other not-shown portion in the MFP 1according to the present invention.

In addition, in the present invention, it is configured so as to becapable of operating the MFP 1 by the mobile terminal apparatus 5.Examples of the mobile terminal apparatus 5 include a mobile phone(which also includes one called smart phone), a mobile informationterminal, a mobile PC and the like. The mobile terminal apparatus 5 hasa display panel 52 illustrated by a display panel 52, an operationportion for receiving a user operation, and a wireless communicationportion 51 which will be described below, in addition to a main controlportion 50 for controlling the whole.

Although description will be given below assuming that the display panel52 is a touch panel and is also used as a part of the operation portion,an operation button may be provided separately to perform the operationbased on a UT image displayed on the display panel 52 with the operationbutton. The main control portion 50 may be also configured by hardwareand a program, similarly to the main control portion 10. A program forcausing processing on the mobile terminal apparatus 5 side according tothe present invention to be executed while control ling each of theportions 51 and 52 and other not-shown portion by the hardwarecorresponds to the program (firmware or software). In addition, the maincontrol portion 50 may be also configured only by the hardware,similarly to the main control portion 10, and in such a case, adedicated micro computer, a dedicated integrated circuit/chip set or thelike may be mounted for executing controlling of each of the portions 51and 52 and other not-shown portion in the mobile terminal apparatus 5according to the present invention.

Moreover, each of the authentication server 2, the cloud server 3 andthe content server 4 has a main control portion. The main controlportion may be configured by hardware and a program, similarly to themain control portion 10. A program for causing processing on each serverside according to the present invention to be executed while controllingeach portion in the server, which will be described below, and othernot-shown portion by the hardware corresponds to the program (firmware).In addition, the main control portion may be also configured only by thehardware, similarly to the main control portion 10, and in such a case,a dedicated micro computer, a dedicated integrated circuit/chip set orthe like may be mounted for executing controlling of each portion ineach server according to the present invention, which will be describedbelow, and other not-shown portion. However, a universal computer suchas a PC is also applicable as a computer for the server.

This system schematically has such a configuration. Description will begiven below for a configuration and a function of each apparatus in thissystem, with reference to FIGS. 2 to 4 in combination. FIG. 2 is a viewshowing an example of an operation panel of an MFP in the image outputsystem of FIG. 1, and FIG. 3 is a view showing an example of a displaypanel of a mobile terminal apparatus in the image output system ofFIG. 1. In addition, FIG. 4 is a view showing another example of thedisplay panel of the mobile terminal apparatus in the image outputsystem of FIG. 1, which is a view showing an example when a userdifferent from that of the example in FIG. 3 uses.

First, the wireless communication portion 11 of the MFP 1 is aninterface communicating with the mobile terminal apparatus 5. Thecommunication party is the wireless communication portion 51 provided onthe mobile terminal apparatus 5 side and the wireless communicationportion 51 is also an interface for carrying out communicationwirelessly.

The wireless communication portion 11 and the wireless communicationportion 51 may be capable of communicating with each other indoors or ona floor where at least the MFP 1 is installed, but may have acommunication system in which communication is allowed only when closingto a position proximate to the MFP 1. For example, a wireless LAN suchas Wi-Fi (registered trademark), infrared-ray communication, Near FieldCommunication (NFC) such as Bluetooth (registered trademark) and thelike may be used. Note that, although a wired I/F and a cable may beused in place of the wireless communication portion 11 and the wirelesscommunication portion 51, wireless communication saves more time andeffort for cable connection and is therefore realistic.

The authentication processing portion 13 of the MFP 1 requests userauthentication to the server (the authentication server 2 in thisexample) based on user information including at least useridentification information (hereinafter, referred to as the “user ID”)which is input from the mobile terminal apparatus 5 or the operationportion (the operation panel 12 in FIG. 1) provided in the MFP 1. Notethat, for the communication with the cloud server 3 and the contentserver 4 including the authentication server 2, a not-shown networkadapter may be provided in each apparatus.

Description will be given for the processing of the authenticationprocessing portion 13 more specifically. The authentication processingportion 13, when receiving a connection request by wirelesscommunication from the mobile terminal apparatus 5, requests userinformation such as a user ID to the mobile terminal apparatus 5 andrequests user authentication to the authentication server 2 based on theuser information such as the user ID input from the display panel 52 ofthe mobile terminal apparatus 5. Alternatively, the authenticationprocessing portion 13, when receiving an operation of a connectionrequest from the operation panel 12, displays a UI image requesting userinformation such as a user ID on the operation panel 12 and requestsuser authentication to the authentication server 2 based on userinformation such as a user ID input from the operation panel 12. Theauthentication processing portion 13 may be allowed to perform only oneof processing or both processing. In either case, an authenticationresult as a result of the request may be returned to the requested sideand, not only being returned, preferably displayed so that a user knowsthe authentication result.

The authentication server 2 has a user authentication portion 21 whichperforms user authentication in response to the request from the MFP 1.The user authentication portion 21 stores a user ID and a password beingassociated with each other for user authentication. A user ID and apassword are examples of the above-described user information, but anaddress, a phone number and the like may be used in addition as theabove-described user information. Note that, when the system is simpleand a target of image output in this system is only the content providedby this system, a password may not be used.

In addition, the server (the cloud server 3 in this example) in thissystem has an interface instruction portion illustrated by a UIinstruction portion 31 and preferably has a history storage portion 32which will be described below. When the user authentication by the userauthentication portion 21 succeeds, the UI instruction portion 31specifies a UI image which is displayed on the display portion(hereinafter, illustrated by the display panel 52) in the mobileterminal apparatus 5 for operating the MFP 1 depending on a user ID, andinstructs the MFP 1 to display the UI image on the mobile terminalapparatus 5.

The instruction (a) may be provided by transmitting the UI image to theMFP 1, (b) may be given by instructing which UI image stored in advancein the MFP 1 to be displayed by what procedure, or (c) may be given byinstructing which UI image stored in advance in the mobile terminalapparatus 5 to be displayed by what procedure via the MFP 1. Theprocedure may need a series of UI images and data as to what UI image isshifted by a user operation.

Here, in the case of the above-described (b) an item such as an iconserving as an element may be saved in the MFP 1 so that such an item isstored so as to be readable by the firmware. In the case of theabove-described (c), an item such as an icon serving as an element maybe saved in the mobile terminal apparatus 5 so that such an item isstored so as to be readable by the firmware or the software. In any caseof the above-described (a) to (c), if a user ID and a UI imagecorresponding to a user thereof (or information for specifying the UIimage) are stored being associated with each other, the specificationdepending on the user ID is allowed in the UI instruction portion 31.

In accordance with the instruction by the UI instruction portion 31 asdescribed above, the main control portion 10 of the MFP 1 passes theinstruction to the mobile terminal apparatus 5 by wirelesscommunication. A display on the mobile terminal apparatus 5 side inaccordance with the instruction and an example of the display are one ofmain characteristics of the present invention, and details of which willbe described below.

Moreover, at this time, if the UI image in accordance with theinstruction is also able to be displayed on the operation panel 12because of the capability and the like in the operation panel. 12 of theMFP 1, the UI image is preferably displayed on a display portion of theoperation panel 12 as illustrated by a UI image 60 of FIG. 2. However,such a display may not be performed, and in such a case, a UI image of abasic screen or a UI image of a predetermined screen of the MFP 1 may bedisplayed on the display portion of the operation panel 12.

Note that, the operation panel 12 in the example of FIG. 2 is alsoprovided with a start button 65 for executing image output in a colormode and a start button 66 for executing image output in a monochromemode. In addition, the operation panel 12 is also provided with anantenna portion of an infrared-ray transmission/reception portion and aBluetooth (registered trademark) communication portion, or an antennaportion 67 of Wi-Fi (trademark), which corresponds to the wirelesscommunication portion 11.

The UI image 60 is an example of a UI image when a user aaaaa uses aservice (with a service name of XX) for performing image output, and hasan operation area 61 customized for the user aaaaa. The UI instructionportion 31 is configured so as to be able to set the order of functionsor to select an UI image itself from the mobile terminal apparatus 5 orother information processing apparatus (such as a PC). In addition, theoperation area 61 is in such a state that functions are in the order setto the UI instruction portion 31 in advance by the user aaaaa ordetermined based on the operation history as described below, as well asone function similarly set in advance or determined based on theoperation history is being selected.

Further, image output setting similarly set in advance by the user aaaaaor determined based on an operation history corresponds to eachfunction, and one function (for example, “Copy 1”) is selected to shiftto a not-shown setting screen UI so that image output setting of thefunction is also able to be changed on site. In addition, when a startbutton 65 or 66 is selected in a state where one function (illustratedby “Copy” 1) is selected in a gray-out manner, color or monochromeprinting is performed with the function and image output setting (forexample, setting of performing layout printing with 2 in 1 on an A4sheet of paper). Although such image output is possible by the MFP 1installed in every store of the CVS, the device which isnon-color-compliant may correspond only to monochrome printing.

Moreover, since the start buttons 65 and 66 are also provided in theoperation panel 12, an explanatory text 62 suggesting a method forinstructing the final image output is preferably displayed on the UIimage 60 of FIG. 2. In addition, content information 63 about a contentprovided for image output by the content server 4 and discountinformation 64 for the content may be displayed. The user selects aselection area included in the content information 63, in this example,a desirable selection area from among profitable information, liveinformation and sightseeing spots, to shift to a lower layer of the UIimage, so that it is possible to select a content subjected to imageoutput finally.

The UI image like the UI image 60 is preferably able to provide the sameas much as possible by the MFP 1 in every place, in the case of the sameuser, the same advance setting and the like, but it often happens thatsome MFP is not able to provide the same due to a difference of themodel or is difficult to rewrite the firmware into such processing. Asdescribed above, in a case where the MFP 1 does not have a function ofperforming such a display and the like, an image for a default screen(for example, a UI image of an initial screen) itself may be used, but,for example, only the explanatory text 62 of the start button may beeliminated from the display in FIG. 2.

In order to make up for such a difference of the model of the MFP 1,this system gives an instruction to the mobile terminal apparatus asdescribed above, and as to the display, displays a UI image depending onthe user on the display panel 52 of the mobile terminal apparatus 5 forwhich more universal device is distributed.

In the mobile terminal apparatus 5, the main control portion 50 causesthe display panel 52 to display the UI image in accordance with theinstruction described above from the MFP 1. In addition, a resolution ofthe UI image may be specified, but in such a case, the resolution may beable to be displayed on a universal mobile terminal apparatus with adisplay portion. Of course, the resolution may not be particularlyspecified, and it is also possible to adjust on the mobile terminalapparatus 5 side by displaying being enlarged or reduced to fill thedisplay panel 52.

In this manner, the UI image 60 as illustrated in FIG. 3 is displayed onthe display panel 52 of the mobile terminal apparatus 5. The UI image 60of FIG. 3 is basically the same as the UI image 60 of FIG. 2. However,it is a primary purpose to display the UI image 60 of FIG. 3 on thedisplay panel 52, and as far as such a display is possible, the user isable to operate the MFP 1 from the mobile terminal apparatus 5, so thatit is not always necessary to display the same UI image on the operationpanel 12 of FIG. 2 as described above.

In addition, in a state where the UI image as illustrated in FIG. 3(that is, the UI image depending on the user ID) on the mobile terminalapparatus 5 based on the instruction by the UI instruction portion 31,the MFP 1 executes image output for a content acquired from the server(the content server 4 in this example) in accordance with the operationby the user received from the mobile terminal apparatus 5 through thewireless communication portion 11.

This makes it possible to execute printing of a target content (whichmay include printing of FAX reception data), internet FAX transmissionof a target content, copying to a transportable recording mediumattached to the mobile terminal apparatus 5 and the MFP 1, and the like.Moreover, from the UI image 60, in addition to setting of a destinationof internet FAX and displaying of an address book, reception setting ofinternet FAX (which corresponds to printing or copying to atransportable recording medium of a received facsimile image as acontent) and transmission setting of internet FAX are allowed, thesetting contents thereof are also determined by the advance setting ofthe user and further able to be changed also from the UI image 60.

Description will be given for the UI image 60 of FIG. 3. For the UIimage 60 of FIG. 3, the start buttons 65 and 66 are provided in theoperation panel 12 and by selecting any one of them, image output isexecuted, so that the explanatory text 62 suggesting a method forinstructing the final image output may be displayed on the UI image 60of FIG. 3. Thereby, the start button 65 or 66 in the operation panel 12is finally pressed to execute the processing. Alternatively, icons likethe start buttons 65 and 66 may be included in the UI image 60. Thereby,image output is executed by pressing the start button 65 or 66 in theoperation panel 12 or selecting the icon of the start button 65 or 66displayed on the display panel 52 additionally on the UI image 60 ofFIG. 3, that is, by performing the final start operation in either theMFP 1 or the mobile terminal apparatus 5. With either method, it ispossible to execute the image output without confusion of the user.

Moreover, the content information 63 and the discount information 64similar to those in the UI image 60 of FIG. 2 may be displayed on the UIimage 60 of FIG. 3. The user is able to select a content subjected toimage output finally by shifting to a lower layer of the UI image 60.

A UI image 60 a illustrated in FIG. 4 is one in which functions set inadvance by a user bbbbb or determined based on an operation history andimage output setting are displayed and is different from the UI image 60of FIG. 3. In this example, an example is given in which the order of“Copy 1”, “Copy 2”, “Print 1” and “Print 2” in the operation area 61 issimply changed to “Print 1”, “Print 2”, “Copy 1” and “Copy 2”, butwithout limitation to such a simple difference, arrangement of aselection area of each function may be determined depending on a user IDand further whether or not to display the content information 63 and thediscount information 64 may be determined depending on a user ID.

In addition, the content information 63 of the UI image 60 a of FIG. 4has a different store name from the content information 63 of the UIimage 60 of FIG. 3, such a difference is able to be made simply byallowing a UI part for providing a content to be set in advance for eachuser. For example, a content purchasing function may be allowed to beset in advance so as to utilize the function. Moreover, as describedbelow, even by displaying the preferable store corresponding to browsingof Web stores by the user or the usage history, it is possible to make achange depending on the history.

In addition, as to a timing when the MFP 1 determines a contentsubjected to image output, with respect to a plurality of contents whencontents are registered by a plurality of users and a content providedas a service from the store side by the content server 4, a target ofthe image output may be determined in accordance with the user operationby displaying a UI image for selecting a content subjected to the imageoutput. When the user registers a content and when there is one contentregistered, the content may be determined automatically as the target ofthe image output or may be determined at a stage where a file name andthe like are caused to be confirmed in advance once to receive theoperation for the confirmation.

In addition, a timing when the MFP 1 acquires a content subjected to theimage output may be when the start button 65 or 66 is pressed, or if asimilar button is also displayed on the display panel 52, when thebutton is touched. Further, a content subjected to the image output is acontent stored in the content server 4, the content may be transmitteddirectly from the content server 4 to the MFP 1, but may be transmittedfrom the content server 4 to the mobile terminal apparatus 5 so that themobile terminal apparatus 5 transmits the content to the MFP 1.

In this manner, since it is configured such that the user operates theMFP 1 by the mobile terminal apparatus 5 for image output while viewinga UI image, even an MFP which is not provided with an operation panelwith high functionality is able to be operated by the mobile terminalapparatus 5 as if there is the operation panel 12 with highfunctionality. It is also possible to provide such a UI that a functiondesired by the user is able to be executed by one click of the startbutton 65, 66 or the like among image output functions such as a printfunction and an internet FAX transmission function, for example, basedon advance setting by the user.

Next, description will be given for the history storage portion 32provided in the cloud server 3. The history storage portion 32 acquiresfrom the MFP 1 a history of a user operation (operation history) fromthe mobile terminal apparatus 5 for each user operation or after aseries of user operations are finished to store the history in relationto a user ID. Then, the UI instruction portion 31 changes a UI image tobe specified depending on the user ID in accordance with the history ofthe user operation which is stored, that is, by learning automatically.The history referenced in the change may employ the frequently-usedfunction or the frequently-used image output setting by takingstatistics or may employ the latest function and image output setting.

In this manner, by providing the history storage portion 32, it becomespossible to change the UI image specified by the UI instruction portion31 depending on the user operation and the user is able to customize theUI image based on the usage history and summary that the user hasoperated in the MFP 1 until now. For example, it also becomes possibleto provide such a UI that a function desired by the user is able to beexecuted by one click of the start button 65, 66 or the like among imageoutput functions such as a print function and an internet FAXtransmission function, for example, based on the usage history of theuser until now. In addition, the UI instruction portion 31 specifies aUI image by referring not only to the user operation in the MFP 1 butalso to a browsing history and a purchasing history at a sales site onthe Web provided by a company managing the store where the MFP isinstalled, for example, so that it is possible to present the contentinformation 63, for example, as shown in FIGS. 2 to 4 based on thebrowsing history and the purchasing history.

Moreover, the server (the content server 4 in this example) whichprovides a content is preferably provided in this system, and thecontent server 4 will be described. The content server 4 has a contentregistration portion 41. The content registration portion 41 receivescontent registration processing performed through the network N as wellas by specifying user information such as a user ID from the mobileterminal apparatus 5 or an information processing apparatus (such as aPC) different from the mobile terminal apparatus and stores the contentin relation to the user ID. Thereby, the MFP 1 is able to acquire thecontent from the content server 4 and execute image output for theacquired content.

In the registration processing, the content registration portion 41preferably registers image output setting regarding the content inrelation to the content, that is, allows the user to register also imageoutput setting in registering the content. Thereby, sheet sizeinformation and color tone information (such as a density and aresolution) finely adjusted by the user are also managed in a state ofbeing allowed to access from the cloud server 3 so that the sameinformation is able to be acquired for printing out even though the useraccesses from any store.

Here, an example is taken that the image output setting is managed bythe content server 4, but the image output setting may be managed by thecloud server 3, and in such a case, by associating not only with a userID but information indicating a content (such as a content ID), it ispossible to display a UI image in application on the image output of thecontent registered on the content server 4. Moreover, although anexample is taken that the image output setting is also registered forthe content registered in the content server 4 by the user, theregistration target is not only the content acquired or produced inother than the cloud system by the user.

Other content also serves as a registration target and is also able tobe a registration target of the image output setting. Although the imageoutput setting described above is basically the same as the image outputsetting described with reference to FIGS. 2 to 4, the image outputsetting described to be registered by the content registration portion41 is different in terms of being the image output setting for theuniquely decided content registered by the user. The image outputsetting described with reference to FIGS. 2 to 4 is the image outputsetting which is generally usable, and may be set by the user in advanceto the UI instruction portion 31 to be read out or may be determined bythe UI instruction portion 31 based on the history with reference to thehistory storage portion 32. The advance setting is also able to berealized by configuring such that “an arbitrary content” is virtuallyregistered in the content registration portion 41 and the image outputsetting is performed for the content. Based on the similar point ofview, it is also possible to configure such that the contentregistration is performed by specifying a content provided from thestore side and the image output setting is performed for the content.

As described above, according to this system, an MFP in every modelbecomes possible to provide a user-customized UI Image from the cloudserver 3 to the MFP 1 so as to easily enable the operation by theuser-customized UI image. Further, by registering image output settingin advance in each function, it is possible to perform the image outputconsistent with the setting. In addition, a manufacturer is able toeasily develop the mode of such an MFP 1 and to add the function just byversion upgrade of the firmware of the main control portion 10 withcommon specification of simply providing a wireless communicationportion. In particular, it is possible to provide this service withoutconcern even for a lineup that a size of an operation panel is differentdepending on the model.

Moreover, as illustrated in FIG. 2, this system is also able to beconfigured such that, by preparing models of the MFP 1 (at least,display performance), based on a user ID or the like registered inadvance by the user, a UI image consistent with the user is provided tothe operation panel 12 of the MFP 1 using the function of the cloudwithout depending on an environment such as places of the store of theCVS. That is, this system enables to provide a user-customized UI imagefrom the cloud server 3 to the MFP 1, and is also possible to provide aUI capable of executing a function desired by the user by one clickamong image output functions such as a print function and an internetFAX transmission function, for example, based on the usage history untilnow by the user.

Next, description will be given for an example of a flow of image outputof this system, with reference to FIG. 5 and FIG. 6. FIG. 5 is aflowchart for explaining an example of a flow when a user performs imageoutput using the image output system of FIG. 1, and FIG. 6 is aflowchart for explaining an example of an operation of an MFP in theimage output system of FIG. 1.

First, a task flow of a user will be described based on FIG. 5. The usersubscribes to a service provided in this system on a dedicated Web site(for example, a site provided on the cloud server 3) (step S1). At thistime, for example, a user ID of 10-digit alphanumeric characters or thelike is issued or is determined by the user so as to avoid overlapping.The user ID is described with reference to FIGS. 1 to 4 and theregistration contents are stored in the user authentication portion 21and the like.

In addition, the user sets a content service to be used at the time ofmembership registration or later (step S2). The setting here is to set,for example, a service which is likely to be used. When requiring a fee,the price may be differentiated depending on the number of services.Then, the user sets a function which is most likely to be used (aprinting function, that is, a print function in this example) in advanceat the same time with step S2 or later (step S3). At this time, acontent to be printed is also registered.

The user goes to a store of the CVS where the MFP 1 in cooperation withthe cloud is installed (step S4), and when registration in the cloudservice has been already made (in the case of YES at step S5),operations of steps S7 to S11 are performed. On the other hand, when theregistration has not been performed at step S1 and the like (in the caseof NO at step S5), whether or not to register to the cloud service isjudged (step S12), and in the case of performing the registration (inthe case of YES at step S12), similar tasks to steps S1 to S3 areperformed from the MFP 1 or the mobile terminal apparatus 5 which isowned (steps S13 to S15). In the case of NO at step S12, for using atleast the service, for example, after acquiring a temporal ID from thecloud server 3 (step S16), the tasks of steps S14 and S15 are performed.After step S16, the flow goes to step S6.

At step S6, since the registration or the temporal registration has beenalready performed in the cloud service at this stage, an operation fordisplaying a network setting screen as a log-in screen is performed onthe operation panel 12 of the MFP 1 to which the user goes or on thedisplay panel 52 of the mobile terminal apparatus 5 (step S6). When itis judged that a user ID is directly input to the MFP 1 (in the case of“direct input” at step S7), the user ID is input from the operationpanel 12 to perform user authentication (step S8). On the other hand,when it is judged that the user ID is input from the mobile terminalapparatus 5 (in the case of “wireless communication” at step S7), theuser ID is input from the mobile terminal apparatus 5 near the operationpanel 12 to perform user authentication via wireless communication (stepS10). After the processing of steps S8 and S10, a UI image depending onthe input user ID is displayed on the display panel 52 (and theoperation panel 12) in either case, and is operated to execute printingof a content which has been registered (steps S9 and S1). Steps S9 andS11 are described separately, but are the same processing.

Next, description will be given focusing on processing in the MFP 1 asprocessing in this system.

First, the MFP 1 displays the network setting screen on the operationpanel 12 corresponding to step S6 and also on the display panel 52 bywireless communication (step S21). The MFP 1 judges whether the user IDis input directly by the operation panel 12 or input by the displaypanel 52 of the mobile terminal apparatus 5 (step S22), and in theformer case, processing of steps S23 to S25 is executed, and in thelatter case, processing of steps S29 to S31 is executed.

At step S23, inputting of the user ID is received to request userauthentication to the authentication server 2. Then, in accordance withthe request, the cloud system carries out cloud cooperation, so that theauthentication server 2 performs user authentication, and when it fails,notification of failure is made, and when it succeeds, a UI imagedepending on the user ID is specified by the cloud server 3 and theinstruction to display therefor is performed to the MFP 1 (step S24).Next, the MFP 1 displays the UI image on the operation panel 12, ifpossible, and displays the UI image on the display panel 52 of themobile terminal apparatus 5 (step S25).

As to the UI image displayed at step S25 and step S31 described below,based on the setting at steps S2 and S3 of FIG. 5, a function to bedisplayed on the UI image and a function to be displayed in a state ofbeing already selected at a position where the selection is made mosteasily (the print function in this example) are determined. However, inthe case of considering the history of the user operation, if thefunction selected by the user is different after the display of the UIimage, the selected function may be displayed next time at a positionwhere the selection is made most easily.

Subsequent to step S25, the MFP 1 performs image output in accordancewith the user operation received from the operation panel 12 or thedisplay panel 52 (step S26). In addition, the MFP 1 transmits a usagehistory of a function in the UI image and an access history (such aswhat type of content is accessed) in a content providing server to thecloud server 3 (step S27). Then, by cooperating with the cloud, thecloud server 3 performs totaling of the history (step S28).

In addition, at step S29, inputting of the user ID is received bywireless communication to request user authentication to theauthentication server 2. Then, in accordance with the request, the cloudsystem carries out cloud cooperation, so that the authentication server2 performs user authentication, and when it fails, notifying to befailed, and when it succeeds, a UI image depending on the user ID isspecified by the cloud server 3 and the display and the instructiontherefor is performed to the MFP 1 (step S30). Next, since the user hasdesired the operation from the operation panel 52 of the mobile terminalapparatus 5, the MFP 1 displays the UT image only on the display panel52 without displaying the UI image on the operation panel 12 (step S31).Then, the flow goes to step S26.

With such processing, the user is able to use the cloud service byoperating the user-customized UI image from the mobile terminalapparatus 5. Moreover, since it is also possible to cooperate withgathering of information of a function used by the user and an accessedservice via the network in the cloud server, it is possible to totalinto data for fulfilling client satisfaction by gathering and totalinguser needs immediately.

In this manner, this system has improved usability and is applicable toa service which is able to be started easily wherever the store of theCVS and the like and institutions are. Here, considering that thissystem is placed in the CVS mainly, it is possible to provide contentinformation which is frequently used by the user based on the history ofthe user operation and similar content information, and also to providea service which is usable in the store of the CVS and the like,including coupon information, information of an expiring date for pointsand the like. They are as illustrated by the content information 63 andthe discount information 64 of FIGS. 2 to 4. In addition, the cloudserver 3 is able to cooperate with the content server 4 of variouscontents provided by the store, thus making it possible to provideinformation desired by each user to the user corresponding to thetotaled access frequency, resulting that it is also possible to producenew functionality by catching up user requests. Moreover, it is possibleto total information in the day unit and in the user unit to some extentfrom the history of these user operations, which is able to be usefulfor maintenance by a service man and extraction of user needs of theuser. In this manner, the above-described information provided as aservice from the store side is also able to be useful for the needsanalysis in each store of the CVS and the needs analysis in the wholeCVS, which is able to be configured to be collectively managed by thecloud server 3 and the like.

In addition, the history of the user operation including the functionused by the user and the like is usable as sales performanceinformation, particularly when the content provided from the contentserver 4 by the store side is subjected to image output. Accordingly,when the user enjoys the service, acquisition information (such as ageinformation judging the age of the user) is supplied from the store andthe like to a POS (Point Of Sale) server as well as information of thehistory of the user operation described above in the cloud server 3 isautomatically supplied to the POS server, so that it is possible toaccumulate sales performance information in the POS server.

Moreover, although there is a case where a service man does maintenanceof the MFP 1, it may be configured such that the user is able totransmit a service man call from the MFP 1 directly or via the mobileterminal apparatus 5 to the cloud system side. In addition, similarly tothe user, it is configured such that a UT image customized for a serviceman is also able to be displayed, and at the time when the service mandoes maintenance, a maintenance state is transmitted to the cloud server3 from the operation panel 12 or the similar UI image customized for theservice man. It is also possible to configure such that, in response tothe transmission, the cloud server 3 totals alert information such asserviceman calls generated so far, so that the response is given to theMFP 1 to display consumables necessary for the MFP 1, a portion whichrequires maintenance and the like immediately on the operation panel 12or the display panel 52.

As described above, although description has been given assuming thatthe server according to the present invention (the content server 4 inthe example of FIG. 1) stores a content subjected to image output, thissystem is not limited to such an example and may be one in which thecontent subjected to image output is stored in the mobile terminalapparatus 5.

That is, when performing image output, the MFP 1 executes the imageoutput for the content acquired from the mobile terminal apparatus 5. Ofcourse, in this case as well, a user operation is received by the mobileterminal apparatus 5 and the MFP 1 executes the image output of thecontent in accordance with the user operation in a state where a UIimage is displayed on the display panel 52. The content may be acquiredby requesting from the MFP 1 or by contraries, may be transmitted to theMFP 1 from the mobile terminal apparatus 5 side.

Other content subjected to image output may be one, for example, readfrom a transportable recording medium such as a USB memory attached tothe MFP 1. Moreover, in these examples as well, it may be configuredsuch that the image output of the content is also possible by the useroperation from the operation panel 12 of the MFP 1.

As described above, although description has been given for the imageoutput system according to the present invention, the present inventionis also able to employ the form of an image output method for performingimage output in the above-described system. The method and applicationsare as described for the image output system and the description ofwhich will be omitted. In addition, the present invention can alsoemploy the form of a program causing a computer in each apparatus in theimage output method to execute. As the computer in each apparatus,various types of computers including a micro computer, a universalintegrated circuit/chip set which is programmable, and the like areapplicable. As described above, a universal computer is also applicableto the computer for the server. In addition, these programs are able tobe distributed via the network such as the Internet, or via a broadcastwave, further via a transportable recording medium.

Moreover, according to the present invention, in an image output systemprovided with a server and a plurality of multi-functional peripheralsconnected to the server through a network and capable of outputting animage, a multi-functional peripheral in every model is easily allowed tooperate with a user-customized user interface image.

What is claimed is:
 1. A server capable of performing communication witheach of a multi-functional peripheral and an external terminal device,comprising a control portion, wherein the control portion is configuredto execute: storing, when the multi-functional peripheral executes imageoutput according to a user operation that is input from the externalterminal device or an operating portion provided on the multi-functionalperipheral in a state where a first user interface image is displayed onthe multi-functional peripheral or/and a state where a second userinterface image is displayed on the external terminal device, a historyof the user operation; and transmitting a content to be displayed in thefirst user interface image and the second user interface image based onthe stored history of the user operation.
 2. The server according toclaim 1, wherein the server is capable of performing communication witheach of a plurality of multi-functional peripherals, and the controlportion is configured to further execute transmitting the contentaccording to a place that the multi-functional peripheral operated by auser is placed.
 3. The server according to claim 1, wherein the controlportion is configured to further execute supplying the history of theuser operation to another server when image output of the content isexecuted by the multi-functional peripheral according to the useroperation.
 4. The server according to claim 1, wherein the first userinterface image is made not to be displayed on the multi-functionalperipheral when the second user interface is made to be displayed on theexternal terminal device.
 5. The server according to claim 1, whereineach of the first user interface image and the second user interfaceimage includes user-customized information.
 6. The server according toclaim 1, wherein the control portion is configured to further executeacquiring the history of the user operation after the user operation isfinished.